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METHOD AND APPARATUS FOR ELIMINATING 
TELEVISION COMMERCIAL MESSAGES 
BACKGROUND OF THF INVENTinM 

1. RELATED APPLICATIONS 

This is a continuation-in-part of co-pending application Serial No. 
08/573.433 filed December 15. 1995, which Is a continuation-in-part of 
application Serial No. 08/304,781 filed September 12. 1994, which is a 
continuation-in-part of application Serial No. 08/177,813 filed January 4, 
1994, which is a continuation-in-part of application Serial No. 08/002,782 
filed January 8, 1993, now U. S. Patent No. 5,333,091, and of application 
Serial No. 08/103,067 filed August 6, 1993 now U.S. Patent No. 5.455,630. 

2. FIELD OF THE INVENTION 

This invention relates to the field of video recording and playback 
systems, and particulariy to a method and apparatus for selectively omitting 
certain program content during playback of a recorded video signal. 

3. BACKGROUND ART 

It is commonplace to record a commercially broadcast television 
program on a video tape recorder (VTR, also referred to as a video cassette 
recorder or VCR) for viewing at a later time. When later viewing the 
recorded program, many, if not most, viewers prefer to watch only the 
program material without also viewing commercials, promotional messages 
and the like that are typically broadcast at intervals during the program. 

Even before the advent of popularly priced video tape recorders, 
there have been many attempts to provide home television viewers with a 
system to suppress commercial messages. Early efforts included systems 
that would mute the audio signal for a predetemiined period of time when a 
commercial message was sensed. As VCRs became more popular and 
"time-shifting" became a convenient way to view television programs, more 
sophisticated methods for eliminating commercial messages have been 
proposed. 

One prior art approach to commercial elimination has been to pause 
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the VCR in the record mode when a commercial message is sensed. A 
system of this type is disclosed in U.S. Patent No. 4,319,286, which issued 
on March 9, 1982 to Hanpachern. In this system, the absence of video 
modulation during a video frame (i.e., a blank frame) is detected and used 
to trigger a timing circuit. When triggered, the timing circuit causes a pause 
command to be sent to a video tape recorder. The pause command 
remains asserted for a predetermined period of time, or longer If the timing 
circuit is retriggered. For example, the timing circuit may be set for 32 
seconds so that if blank frames are detected at 30 second intervals (a 
typical length for a commercial message) the VCR will remain in the pause 
mode until 32 seconds after the last such blank frame. Quite a few prior art 
references disclose variations on this type of system, wherein the VCR is 
paused for a fixed period of time following detection of a blank frame in the 
video signal. For example. PCT Application No. W08 1/00945 by Johnston 
and Koombes discloses a system of this type. Such systems are claimed to 
be relatively effective for eliminating commercial messages, but suffer 
certain drawbacks. In this regard, program material immediately following a 
commercial break is irretrievably lost since the VCR is held in the "pause" 
mode for a predetemrttned period of time (30 to 60 seconds or more) 
following each break in the television signal. Furthermore, additional 
program material may be irretrievably lost if the timing circuit is falsely 
triggered, such as by a fade between scenes in the program. 

Other prior art systems have sought to overcome these drawbacks. 
For example. U.S. Patent No. 5.151,788 to Blum discloses a system for 
eliminating commercials from a video signal that performs real time 
analysis of the video signal immediately following a blank frame. If there is 
a high level of "activity" in the signal immediately following a blank frame, a 
commercial message is presumed and the VCR is commanded to pause. 
On the other hand, if a low level of activity Is detected, the preceding blank 
frame is presumed to be a fade and the VCR is commanded to resume 
recording. This approach solves the problem of losing a fixed amount of 
program material if a VCR pause if falsely triggered, but it is still susceptible 
to misclassification. If a program fade is immediately followed by an "active" 
scene, this will be misclassified as a commercial. On the other hand, a 
commercial with a low level of "activity" will be misclassified as program 
material. 
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A different approach to eliminating commercial messages is to 
automatically rewind a VCR to the beginning of a commercial message 
each time one Is detected while recording a television program. One such 
system is disclosed In U.S. Patent No. 4.750,052, which issued on June 7. 
1988 to Poppy and Samelson. A virtually identical system is disclosed in 
U.S. Patent No. 4,752,834, which issued on June 21 , 1988 to Koombes. In 
both of these systems, fades (I.e., blank frames) in the video signal are 
detected and the time interval between successive fades is determined In a 
timing circuit. If the timing criteria for a commercial message are met, the 
VCR is rewound to the position of the fade associated with the beginning of 
the commercial message and the VCR is returned to the record mode. This 
process repeats for each commercial message that is detected. These 
systems permit an editing decision to be made after an entire commercial 
has been aired; however, as with the other systems previously described, 
program material is still irretrievably lost if there is a false detection of a 
commercial. Furthermore, the frequent rewinding of the tape during long 
commercial breaks accelerates the wear of the VCR tape transport 
mechanism as well as the tape itself. 

Yet a different approach is disclosed by Mizuki in Japanese patent 
document 58-146072, which was published on August 31, 1983. A similar 
system is disclosed in U.S. Patent No. 4,570,192, which issued on February 
11, 1986 to Hori. In both of these systems, a video program is viewed by an 
operator as the program is recorded or is replayed. The operator places an 
electronic mark on the tape at the beginning and end of each commercial 
message or any other undesired recorded material. When the tape is 
subsequently replayed, either for viewing or transcription to another tape, 
the VCR is commanded to fast-fonward through the portions of tape 
bounded by the applied marks. These systems rely entirely on human 
intelligence to classify the different portions of the video signal. 

Still other systems are known that discriminate commercial 
messages based on characteristics of the transmitted video signal. A 
system of this type has been marketed in Japan by Mitsubishi under the 
name "Auto-Cut". In this system, the audio channel is monitored for the 
presence of a second audio program (SAP) and/or stereo modulation. 
Many of the programs that viewers wish to tape are broadcast in dual 
languages (e.g., Japanese and English) and/or with monaural sound. 



BNSDOCID: <WO 9807273A1_L> 



SUBSTITUTE SHEET (RULE 26) 



wo 98/07273 



PCT/US97/13962 



However, commercial messages in Japan are generally broadcast in stereo 
and in the Japanese language only. Thus, a VCR with the Auto-Cut system 
is able to record a monaural program or one with SAP and suspend 
recording during commercials. Other systems marketed in Japan operate 
on a similar principle, but record the entire program and then place the VCR 
in a fast scan mode during playback when stereo sound or the absence of 
SAP is detected. 

The prior related applications referred to above describe improved 
systems for automatically classifying segments of a recorded television 
program as either program material or commercial message material and 
for then automatically scanning past the commercial messages during 
replay of the recorded program. In many situations, however, it may be 
desired to skip past commercial messages and other unwanted material in 
a recording that has not been marked in accordance with the invention 
disclosed in the earlier applications. One such situation arises when a 
viewer desires to skip past the various commercials, trailers and other 
segments that typically precede pre-recorded videos of motion pictures. In 
these situations, there Is a need for a system that will semi-automatically 
skip through unwanted material to find the beginning of a program segment 
that the viewer wishes to see. 
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SUMMARY OF THF iMVPMT.n^ 

The present invention provides a method and apparatus for 
controlling the operation of a video recording and playback device so as to 
autonrjatically eliminate commercial messages during playback of a 
recorded television signal. 

The apparatus of the present invention comprises a video player 
having at least a play mode, a fast scan mode and a reverse mode; a 
recording medium for insertion into the video player, the recording medium 
having a video signal recorded thereon; means for commanding the video 
player to enter the fast scan mode; and means for detecting events within 
the video signal (such as black frames in combination with silent frames). 
The apparatus further comprises timer means for determining that a 
detected event is not followed by another event within a predetermined 
period of time and means responsive to the timer means for commanding 
the video player to enter the reverse mode until reaching a position on the 
recording medium corresponding to the previously detected event. 
Alternatively, the apparatus further comprises means for storing data 
identifying a location the recording medium of a most recently detected 
event and means for commanding the video player to enter the reverse 
mode until reaching the location on the recording medium of the most 
recently detected event. In the exemplary embodiment of the invention, the 
recording medium is a video tape; however, the invention may be practiced 
with other media such as optical disks and magnetic disks. 

The present invention also provides a method of cueing a video tape 
having a video signal containing a recorded thereon to a beginning of a 
program segment comprising the steps of advancing the video tape at a 
speed faster than a normal play speed; monitoring the video signal as the 
video tape is advanced to detect events therein; analyzing the detected 
events to identify an event associated with the beginning of program 
segment; reversing the video tape to a location corresponding to the event 
identified as associated with the beginning of the program segment; and 
commencing normal play of the video tape at the beginning of the program 
segment. 
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More generally, the present invention provides a method of cueing a 
video recording medium having a video signal containing a program 
recorded thereon to the beginning of a program segment comprising the 
steps of advancing through the recorded video signal at a speed faster than 
a normal play speed; monitoring the video signal as it is advanced to detect 
events therein; analyzing the detected events to identify an event which has 
no following event within a predetemiined period of time; and commencing 
nomial play of the video signal at the location of such event. 
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BRIEF DESCRIPTION n P THE nPAWlMftQ 

Figure 1 is a functional block diagram of a commercial elimination 
system according to the present invention. 

Figure 2 is a functional scfiematic of the video event detector 
circuitry. 

Figure 3 is a functional schematic of the audio event detector 
circuitry. 

Figure 4 Is a functional block diagram of an alternative embodiment 
of a commercial elimination system according to the present invention. 

Figure 5 Is a schematic diagram of the video line Integrator of Figure 



Figure 6 Is a schematic diagram of the audio signal integrator of 
Figure 4. 

Figure 7 Is a functional flow diagram of the recording phase. 

Figure 8 is a functional flow diagram of the recording phase in an 
alternative embodiment of the invention. 

Figure 9 illustrates the operations performed in the tape marl<lng 

phase. 

Figure 10 is a functional flow diagram of the playback and over-ride 
phases. 

Figure 1 1 illustrates over-writing the control track signal to place 
commercial elimination marks on the video tape. 

Figure 12 Illustrates the format of the sync mark. 

Figure 13 illustrates the fomfiat of the "A" mark. 

Figure 14 Illustrates the format of the "B" mark. 
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Figure 15 is a schematic diagram of the video field Integrator of 
Figure 4. 

Figure 16 illustrates a mode of operation for semi-automatlcally 
advancing to the beginning of a pre-recorded motion picture. 

Figure 17 Illustrates a mode of operation for semi-automatlcally 
advancing to individual trailers that precede a pre-recorded motion picture. 

Figure 18 Illustrates a mode of operation for semi-automatlcally 
advancing past a cluster of commercials in a recording of a television 
program. 

Figure 19 is a functional flow diagram of the semi-automatic modes 
of operation of the present invention. 

Figure 20 Illustrates the use of a VCR head select signal as a gating 
signal to facilitate event detection in the presence of noise bars. 
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DETAILED DESCRIPTIQM OF tHF IMVPMT^ nM 

In the following description, for purposes of explanation and not 
limitation, specific details are set forth in order to provide a thorough 
understanding of the present invention. However, it will be apparent to one 
skilled in the art that the present invention may be practiced in other 
embodiments that depart from these specific details. In other instances 
detailed descriptions of well-known methods, devices and circuits are 
omitted so as to not obscure the description of the present invention with 
unnecessary detail. 

U.S. Patent No. 5,333.091 discloses a control unit that is coupled 
between a conventional VCR and a conventional television 
receiver/monitor. This "stand alone" control unit processes the video signal 
prior to being recorded to detect events within the signal and to modulate 
the recorded signal with a time code. The spacing and duration of the 
detected events is analyzed to classify the video signal between events as 
either program material or commercial message material. A map of the 
video signal is stored in the control unit. Upon playback of the recorded 
program, the map is retrieved and control signals are sent to the VCR to 
rapidly scan through the commercial messages as the program is replayed. 

The subject of this disclosure is a system functionally similar to that 
disclosed In U.S. Patent No. 5.333,091. but which is preferably 
incorporated within a video recording device such as a VCR. Although a 
VCR is the preferred recording mechanism, the invention is not limited in 
this regard and may be practiced with other video recording media such as 
magnetic discs or writable optical discs. Figure 1 is a partial block diagram 
of a video recording device 10 according to the present invention. For 
clarity, only those functions related to commercial elimination are shown 
Of course, it will be recognized that certain functions may be housed in a 
unit that is physically separate from the VCR, if desired. For example, the 
event detection circuitry comprising functional blocks 102, 104, 106 and 
108 and the commercial elimination microprocessor 114 with its associated 
memories 116. 118 could all be housed in a unit that is attached to the VCR 
by an interface cable or umbilical, or that is attached directly to a plug-in 
socket on the VCR. Such a configuration could be utilized to adapt a basic 
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VCR chassis for use in different markets where differing broadcast protocols 
require specialized commercial detection processing. 

Referring still to Figure 1. the "VIDEO IN" and "AUDIO IN" signals 
originate from the VCR tuner in a recording mode of operation or from the 
VCR playback heads In a playback mode of operation. These signals are 
applied at video and audio event detectors 102 and 104, respectively, 
which are more fully described below. The outputs of event detectors 102 
and 104 are inten-ogated by commercial elimination microprocessor 1 14 to 
build an event list that will be processed by a commercial detection 
algorithm. 

All commercial detection and elimination functions are controlled by 
microprocessor 114. Associated with microprocessor 114 is random 
access memory (RAM) 116 for scratch pad storage and read only memory 
(ROM) 118, which stores the operating instructions for processor 114. In a 
typical embodiment, processor 1 14, RAM 116 and ROM 118 should have 
the following minimum characteristics: 



If event detection is implemented external to the processor, such as in 
analog circuitry, processor 114 need not have analog-to-digital (A/D) 
conversion capability. 

Microprocessor 114 communicates extensively with VCR control 
microprocessor 120. With respect to commercial elimination functions, VCR 
control microprocessor 120 monitors the real time tape counter 122 and 
controls the operation of tape transport 124. In some emtradiments, it may 
be advantageous to combine the functions of processors 114 and 120 into 
a single processor. 



Processor type 
ROM space 
RAM space 

Instruction execution time 
A/D converter inputs 
A/D conversion time 
External interrupts 
Communications port 



8 bits 
8K bytes 
700 bytes 

1 to 2 |isec 

2 (multiplexed) 
50 |isec or less 



|2C or equivalent 
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Nearly all of the functions of commercial elimination microprocessor 
114 are automatically controlled. However, two user controls are provided. 
A MODE switch 1 26 allows the user to select a fully automatic commercial 
elimination mode, a manual mode or to disable all commercial elimination 
functions. A SKIP button 128 provides user control of the commercial 
skipping function when operating in the manual mode. Controls 126 and 
128 may be placed on the front panel of device 10; however, they are 
preferably included on a remote control transmitter that provides user 
controls for all of the conventional VCR functions. Alternatively, the choice 
of operating mode may be effected through an on-screen menu rather than 
a dedicated control 126. 

The commercial detection algorithm executed by microprocessor 
114 identifies the location of commercial groups on a video tape. To 
Implement the commercial elimination feature, the video tape is marked at 
the beginning and end of each commercial group. These markings are 
preferably written onto the control track of the video tape with control head 
130. During the marking operation, the commercial Identification markings 
are provided by control signal generator 132. When the video tape is 
replayed, the commercial identification markings are read by control signal 
decoder 134. Although marking of the control track is preferred, the present 
invention may also be practiced by applying the tape markings elsewhere, 
such as In the vertical blanking interval of the video signal, in which case 
the read/write functions can utilize the video play and record heads of the 
VCR. An alternative embodiment of the Invention which does not require 
markings on the video tape is described later in this specification. 

As mentioned above, the "VIDEO IN" and "AUDIO IN" signals 
originate from the VCR playback heads in the playback mode of operation. 
During commercial skipping, it is desirable to mute both of these signals. 
For this purpose, the video signal is routed through video switch 136, which 
also receives the output of video generator 138. The latter circuit provides 
a constant video signal, such as a solid blue screen. Other types of video 
screens may be developed by video generator 138. An operator control 
may be provided to over-ride video switch 136 if it is desired to view the 
video signal as commercials are scanned past. Muting switch 140 mutes 
the audio output signal during fast scan, although this is a feature that is 
already implemented in most VCRs. 
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Video Event Detection 

In one embodiment of the invention that is described in detail herein, 
video event detector 102 detects "black" frames in the video signal. A 
"black" frame is one in which there is essentially no video signal at all, such 
as is characteristic of frames immediately preceding and following 
commercial messages in television broadcasts of the major U.S. networks. 

One embodiment of detector 102 is shown In greater detail in Figure 
2. Detector 102 monitors the incoming video signal and provides a signal 
to the commercial elimination processor 114 whenever the video falls 
within black detect limits. Black frame detection includes the following 
elements: 

Signal clamping, for automatic level control 
Filtering to reduce effects of video noise 
Comparison to a threshold level 
An active area detection window 
Latched detection output 

The detection of black video level is accomplished by comparing the 
video level to a precise threshold level in comparator 208. To be effective, 
this threshold is very near the black video level. Accurate control of the 
video signal is required to allow for correct detection with changing video 
signal levels. The input video signal is first amplified by amplifier 202 and 
then the video level is normalized through the use of a DC clamp circuit 
204. This circuit is activated in the back porch area of each horizontal video 
line. A control pulse signal Is generated in sync separator/timing circuit 106 
that occurs from the trailing edge of the horizontal sync to the end of the 
video back porch. This signal drives clamping circuit 204 that sets a DC 
level In the video signal prior to detection. 

There are many types of noise commonly present In video signals. 
The black detector preferably Includes a low-pass filter 206 to provide 
filtering of fast, spurious luminance signals, characteristic of video "snow". 
This type of noise is very common and originates from poor video reception 
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and other interference. By providing a high frequency bypass to ground, 
the effects of such noise are greatly reduced. 

Once the video signal has been properly conditioned and filtered, it 
is compared against the fixed DC threshold level in comparator 208. The 
threshold is preferably set at about 25 IRE. Any video luminance excursion 
that exceeds this threshold will change the output state of the comparator. 
This function requires a relatively high speed signal comparator capable of 
responding to signal changes in the microsecond range. 

Detector 102 is sensitive to video level excursions that exceed the 
preset threshold level. To prevent false detection, the event detection 
window generator 108 provides a detection window that gates the detector 
within a rectangular portion of the viewable screen at window gate 210. 
Timing for generation of the detection window is provided from sync 
separator and timing circuit 106, which detects the horizontal and vertical 
synchronization pulses within the video signal and provides logic level 
timing signals for the video processing circuitry. Sync separator 106 may 
be constructed with discrete components using well known video circuits or 
may utilize a commercially available integrated circuit such as a Motorola 
MC 44145 device or equivalent. 

The rectangular detection window excludes the start and end of the 
video frame, thereby eliminating video occurring during vertical blanking. 
The window also excludes the left and right edges of the picture to 
eliminate false detection due to video effects occurring in the horizontal 
sync areas of the picture. Some television scrambling systems will produce 
a video signal at the extreme edges of the picture, and this will be 
disregarded. 

The output of the detection comparator 208 can be a fast pulse, 
necessitating that it be latched for sampling by the commercial elimination 
processor. A simple latch device 212 is provided that will capture any 
detection event occurring during the video frame. Once the state of the 
latch has been sampled by the commercial elimination processor it Is 
cleared for the next video frame. 
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Audio Event Detection 

Pauses in television audio are also important indicators for 
commercial detection, especially when they occur simultaneously with the 
occurrence of video events such as black frames. The silent frame detector 
104, shown in greater detail In Figure 3, monitors the incoming audio signal 
and provides an output when periods of silence are detected in the audio. 
The audio detection circuitry contains the following elements: 

Summing of left and right audio channels (if stereo audio) 

Amplification of signal prior to detection 

Filtering 

Comparison to a threshold level 
Latching of detection output 

The input audio signals from both stereo channels are buffered by 
circuits 302. For best response, both left and right audio signals are 
summed together prior to detection. This is easily accomplished using a 
summing node 304 and simple amplifier 306. The audio level Is amplified 
so that detection of very low level audio is enhanced. An amplification 
factor of approximately 2 to 4 wilt provide adequate signal to the audio 
comparator 310. This amplification also provides AC coupling of the signal 
to present an audio level that can be easily referenced to ground. Filter 308 
removes static and other high frequency noise. 

The audio detection Is accomplished by comparing the audio level to 
a fixed threshold level which is set so that any noticeable audio level will 
exceed this threshold and change the output level of the comparator 310. 
The output of the level comparator 310 is held by latch 312 so that any fast 
audio excursion is captured for subsequent sampling by the commercial 
elimination processor. This sampling is typically accomplished every video 
frame, at the same time the black detector is sampled. 



SUBSTITUTE SHEET (RULE 26) 



wo 98/07273 



PCT/OS97/13962 



^6 

Digital event detection 

While event detection with analog circuitry as described above 
provides satisfactory performance, a digital event detection approach is 
preferred since a variety of detection schemes can be implemented through 
software. 

Although it is conventional for television broadcasts within the United 
States to have black frames preceding and following commercial 
messages, such is not necessarily the case. Broadcasters could insert 
virtually any video signal during program breaks. For example, a blue 
screen could be used (as is the case in France). A constant video signal of 
this sort, which need not be black, Is referred to herein as "flat", i.e., the 
video signal is essentially constant throughout the frame. To detect "flat 
frame" events, the video event detection may be implemented to declare an 
event if the video signal within a field or frame varies from an average value 
by a predetemnined amount. Since black frames are a subset of flat frames, 
such a flat frame detector is equally capable of detecting black frames. 

Frames immediately preceding and following commercial messages 
may not even be flat. For example, a broadcaster could insert a patterned 
screen or a solid screen superimposed with the broadcaster's logo. To 
handle these situations, video event detection may employ a scene change 
(or cut) detector which compares the video signal within a plurality of 
screen windows from frame to frame. When the average video signal within 
any one or more of the windows changes by a predetermined amount, a 
scene change is declared. If there are two scene changes within a 
predetermined period of time (e.g., a change from program to a broadcaster 
logo screen followed by a change to a commercial message) an event is 
declared. The time interval for declaring an event of this type should be 
relatively short (on the order of five seconds or less) to minimize the number 
of false events detected. In some markets, such as Japan, the transition 
from program to commercial is an instantaneous cut. Detecting 
commercials in this environment also requires the ability to detect scene 
changes. 

With reference to Figure 4, an alternative embodiment designated 
generally as device 10' is shown, in which any of the above-described 
event detection strategies can be selectively implemented. In this 
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embodiment, the actual event detection is performed by software in 
microprocessor 1 14" based on digitized samples of the video signal from 
video line integrator 152. Processor 114' preferably includes a multiplexed 
analog-to-digital (A/D) converter as previously indicated. One such 
processor suitable for this application is the ST9296 from SGS, which has 
four analog inputs multiplexed to an 8-bit A/D converter. Alternatively, A/D 
conversion could be performed In a separate device that provides digital 
inputs to the microprocessor. 

Figure 5 illustrates the analog circuitry of video line Integrator 152 for 
processing the video signal prior to digital sampling. The VIDEO IN signal 
is preferably integrated across each complete video line between 
successive back porch regions of the horizontal blanking inten/al, although 
less frequent integration may be used as subsequently described. The 
output voltage of the integrator is asserted at one of the multiplexed A/D 
inputs of processor 114' where it is captured for conversion to an 8-blt 
binary value. 

Processor 114' stores each of the binary values which represents the 
integrated luminance level of the respective video line. It should be noted 
that it may not be necessary to sample and store the luminance level of 
every video line. For example, sampling approximately 60 out of the 240 
active lines in a video field may be sufficient to characterize the field. 

With representative samples of the luminance levels of individual 
video lines, processor 114' detects the presence of video events. For flat 
field detection, samples within an entire video field are examined. The 
maximum and minimum luminance values are located and the difference is 
computed. This difference is then compared to a predetermined threshold. 
The field is declared to be "flat" If the difference is below the threshold. 

As already mentioned, black fields (or black frames) are a subset of 
flat fields. To detect a purely black frame, the absolute luminance level of a 
flat field detected with video line Integrator 152 may be tested to determine 
if It is below a predetermined threshold level. However, black frame 
detection may be enhanced by use of a positive slope analog integrator 
153 that amplifies the video signal and Integrates only positive slopes. 
Integrator 153 operates in parallel with video line integrator 152 and is 
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sampled and reset every video field. The digitized sample is then 
compared in software to a fixed threshold to determine if the field is blaci<. 
This approach allows for accurate detection of black fields without falsely 
detecting low luminance sceries within a regular television program. 

A schematic diagram of a circuit suitable for use as video field 
integrator 153 is presented in Figure 15. It should be observed that the 
output signal is inverted, i.e., the reset level is +5V and the signal integrates 
down to ground. However, it is convenient to consider the circuit a positive 
integrator with reference to a "pure black" video signal (7.5 IRE). The black 
level offset adjustment should be set so that a field of pure black video 
generates a negligible integration voltage at the end of the field (i.e., a +5V 
output). 

Scene change or "cut" detection is also made possible with device 
10'. Luminance levels of a video frame are compared to corresponding 
luminance levels of the following video frame. If a sufficient number of lines 
exhibit a change in luminance exceeding a predetermined threshold, then 
a scene change is declared. While it is possible to compare each video 
line for which a luminance value is determined with the corresponding line 
of the next frame, efficiency is increased if comparisons are made between 
corresponding horizontal bands of multiple lines. For example, the screen 
may be divided into 15 horizontal bands and the luminance levels of lines 
within each band averaged. The average luminance of each band is then 
compared to the corresponding value of the following frame. 

Referring now also to Figure 6, an audio signal integrator 154 is 
illustrated. In the case of a stereo VCR, the AUDIO IN signal in Figure 6 is 
the sum of the left and right channels for the previously described 
embodiment. The integrated audio signal voltage is asserted at one of the 
multiplexed A/D inputs of processor 114'. The integrator is reset on 
command from processor 114'. It should be noted that the audio signal 
may be sampled at a much slower rate than the video signal, perhaps only 
once per video frame, in which case silent frame detection involves a 
simple threshold comparison. 

In order to ensure accurate commercial detection, "events" are 
preferably declared on the basis of information obtained from both the 
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video and audio detectors. For example, in the North American market, an 
event is declared only if there is coincidence of a black frame and a silent 
frame. Testing has shown, however, that the audio and video events are 
not always in phase with each other. If there is only a single black frame 
between commercials, audio silence may not occur in the exact same 
frame. To accommodate this, the event detection software should allow 
audio and video events to be skewed from each other by up to several 
frames. 

Coincidence of video and audio events is also problematic when 
detecting cuts. The event detection software should look for audio silence 
that is simultaneous with the video cut, that precedes the video cut, and/or 
that follows the video cut. An alternative approach could implement an 
audio cut detector, somewhat similar to the video cut detector, that looks for 
discontinuities in the audio levels between successive video frames. 

It will be obsen/ed that there is no functional unit in device 10" 
corresponding to the event detection window generator 108 of device 10. 
As should be apparent, the window function can be readily performed by 
software in processor 1 14' which receives the video sync signals as 
interrupts. This gives greater flexibility in sizing the detection window. This 
is particularly helpful for dealing with superimposed identification logos that 
are now included in many broadcasts. These logos, which can be 
transparent or solid, monochrome or color, are most frequently inserted in a 
comer of the picture. Broadcast sources may leave a logo Inserted all of 
the time, may remove the logo during paid commercial time, or may insert 
the logo only periodically. To ensure accurate event detection in the 
presence of logos, the video lines where logos may be present are simply 
ignored. In NTSC format, there are 21 non-picture lines in the vertical 
blanking interval, or about 1.3 milliseconds. Ignoring 4 milliseconds of 
video from the vertical blanking inten/al causes sampling to begin on about 
line 63. In PAL or SECAM fonnats, about 5.2 milliseconds should be 
ignored from the vertical blanking inten/al. An equal amount of time should 
be ignored at the end of the field, before the vertical blanking interval. 

Another approach for excluding graphic logos is to sample alternate 
video fields with different active window areas. For example, the first field of 
each frame could sample only the top two-thirds of the field, thereby 
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excluding all lines in the bottom one-third of the field. The second field of 
the frame could then sample the lines in the bottom two-thirds of the field. If 
either field is determined to be flat or black, this can be declared an event. 



Operational Description 

The operating modes of devices 10 and 10' are basically similar to a 
conventional VCR. Recording and playback of video is accomplished in the 
same manner as on any other VCR. However, when the commercial 
elimination feature is enabled, device 10/10' performs additional functions 
during the various VCR operating modes. Most of these additional 
functions do not require interaction with the user. 

By use of the MODE switch, the user may select between two basic 
operating modes - manual and automatic. This selection affects the 
handling of the video tape during the playback phase of device 10/10' as 
described below. All of the other operating phases of device 1 0/10' are 
identical in both manual and automatic modes. 

The commercial elimination functions of device 10/10' can best be 
understood in terms of the various operating phases, each of which is 
described below. 



Recording Phase 

Figure 7 shows the operations that are performed in the recording 
phase. This phase is active whenever the VCR is in record mode (either 
from key entry, or from timer operation), and the commercial elimination 
feature is enabled. From the user's perspective, video programs are 
recorded as on any standard VCR. However, as Indicated in Figure 7, the 
device Is transparently performing other functions while recording is in 
progress. 

During the recording phase, the event detectors are sampled and the 
tape location of each event, obtained from the real-time tape counter, is 
stoned in an event list in temporary memory. For purposes of commercial 
detection processing, an "evenf is determined in accordance with the 
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particular broadcast protocol of the program being recorded. As previously 
discussed, black video frames are events of interest in many TV markets, 
particularly North America, In other markets, such as Japan, video cuts are 
events of interest. In this description, North American broadcasting 
conventions are presumed. However, it will be recognized that device 
10/10' is operable in other markets with suitable modifications. 

As events are detected, the video tape Is marked in real time with a 
"sync" mark at the location of each detected event. The sync mark, the 
format of which is more fully described below, starts at the beginning of the 
event and has a duration of four video fields. The purpose of the sync 
marks is to precisely indicate the possible start and end points of a 
commercial group. Since the sync marks are written onto the tape prior to 
the event analysis which classifies the program segments between events 
as program or commercial, the sync marks by themselves do not indicate 
the presence of a commercial group. During the subsequent processing 
and marking phases, the positions of the commercial groups will be 
determined and indicated by writing different marks on the tape. 

The sync marks facilitate precise switching between the normal play 
and fast scan modes which provides the best viewing experience in the 
playback phase. However, the use of sync marks is not essential to the 
operation of device 10/10'. Without sync marks, the marks identifying the 
beginning and ending of a commercial group may be written on the tape 
with reference to the real-time tape counter. 

The recording phase is normally terminated whenever the VCR stops 
recording (whether by manual action, end of tape, timer or other function). 
After recording, the commercial elimination processor enters the processing 
phase (described below). If the recording session is less than a 
predetermined minimum length, say 15 minutes, the stored events may be 
erased, and the processing phase may be bypassed. At any time during 
the recording phase the user can disable the commercial elimination 
feature by setting the MODE switch to OFF. This has the effect of canceling 
all data stored for the current session and prevents operation of the 
commercial elimination processing phase. 
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Application of the sync marks to the control track is ordinarily done at 
the time a video program is recorded. However, it may be desired to mark a 
tape that has been previously recorded on a different VCR which lacks the 
commercial elimination functions of the present invention. In such case, a 
modified recording phase is implemented in which the previously recorded 
video tape is "played" while event detection and sync marking proceeds In 
the manner described above. Subsequent processing and marking is then 
accomplished in the same manner as for a newly recorded tape so that the 
tape may thereafter be played with commercial elimination enabled. 



Processing phase 

This phase is active for a short time following the recording phase. 
Its purpose is to analyze the event list and determine when commercial 
groups occun-ed. This process involves applying a commercial elimination 
algorithm (described below) that analyzes the event list and identifies the 
occurrence of television commercial groups. The algorithm produces a 
commercial group list that includes the start and stop point of each 
commercial group identified within the recording session. This list of 
commercial groups is used during the tape marking phase to indicate the 
commercial groups on the video tape. Since the location of individual 
events is no longer needed, the event data in memory may be erased or 
ovenwritten after completion of the processing phase. 

Figure 8 illustrates an alternative embodiment, one that is particulariy 
useful if the size of RAM 1 16 is limited. In this embodiment, the processing 
phase is integrated with the recording phase so that processing is 
performed "on-the-fly". The event list is processed continuously with a 
sliding window having a width of approximately two minutes or as 
necessary to accommodate the decision rules discussed below. The event 
list can thus be organized as a first-in-first-out file requiring only a modest 
amount of RAM since relatively few events occur within a two minute period. 
Such "on-the-fly" processing is particulariy advantageous when cut 
detection is utilized to identify events. In this case, there is a relatively large 
number of events which would require a sizable memory to store the event 
list for an entire recording session. 
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TAPE MARKING PHASE 

Figure 9 diagrammatlcally illustrates the tape marking phase 
operations. After the processing phase is complete, the commercial group 
list In menfK)ry Indicates the start and end points of the commercial groups 
that were identified within the recording session. In the marking phase, the 
VCR is rewound to the approximate beginning of the first commercial group. 
The tape is then marked by writing signais on the control track to identify the 
start and end of each commercial group. Each start and end mark is 
associated with a corresponding sync mark as more fully explained below. 
The real-time tape counter is used throughout the marking phase to 
indicate the current tape position to the commercial elimination processor. 
This is compared to the values stored In the commercial group list to control 
the tape transport and marking operations. Since the sync marks are 
written on the control track during the recording phase, their position is 
always accurate with respect to the recorded video signal. In perfonnlng 
the marking operation, the VCR can use the position of the sync marks to 
correct the real-time tape counter for any accumulated en-or. After the entire 
recording session has been marked (which may take a few minutes), the 
tape is left positioned at the end of the recording. The VCR returns to 
standby mode of either Stop or Off (if in Program Timer mode). Upon 
successful completion of the tape marking phase, the commercial group list 
in memory may be deleted. 

During the marking phase, the VCR operation can be stopped by the 
user selecting OFF with the MODE switch, or by pressing STOP on the 
VCR. This will have the effect of canceling all commercial elimination 
operational phases, and returns the VCR to Stop mode at its current 
position. Subsequent selection of MANUAL or AUTO with the MODE switch 
will not restart commercial elimination operations until the next recording or 
playback session. 

Each commercial group is marked with unique marks at the start 
(called the "A" mark) and end (called the "B" mark) of the group. This allows 
device 10/10' to differentiate the marks, and determine if the tape is 
entering or leaving a commercial group. The location of each B mark is 
advanced ahead of the actual event, to allow time for the VCR to brake and 
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enter the normal Play mode when quickly skipping througli a commercial 
group. 

Whether or not commercials are detected In a recording session, a B 
mark is written approximately 54 seconds before the end of the session. 
This B mark Is written so that any program material of a subsequent 
adjacent recording session will not be missed if the manual skip feature is 
used. This end of recording B mark Is omitted only If the recording session 
was less than 15 minutes In length or if commercial elimination has been 
disabled. 

In performing the marking operation, it is Important to consider the 
effect of transport mode changes. Depending on the configuration of the 
tape transport, errors may occur in the real-time counter when the transport 
is changed between play, stop, rewind and fast fonvard modes. Such 
errors are most likely to occur when changing from an "on-head" mode to 
an "off-head" mode or vice versa. If the magnitude of these errors is 
significant, marking should be accomplished using only "on-head" transport 
modes (e.g., fonward and reverse scan) to reduce the cumulative effect of 
real-time counter errors. 



Playback Phase 

Figure 10 illustrates the operations performed during the playback 
phase. When the VCR Is placed into Play mode, and the commercial 
elimination feature is enabled, the commercial elimination processor 
samples signals from the tape control track, looking for the marks that 
Indicate the start and end of each commercial group. In the automatic 
operating mode, the VCR perfonns the following actions upon detection of 
an "A" mark at the start of each commercial group: 

the VCR outputs a blue screen (unless blue screen feature is 

disabled) ; 

the audio outputs are muted; and 

the tape Is advanced at fast fonward or fonward scan speed. 

When the VCR Is skipping and a "B" mark is detected at the end of a 
commercial group, the VCR perfomns the following actions: 
the tape Is returned to normal Play mode; 
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the video signal is monitored for tlie sync marit at the end of the 
commercial group; 

when the sync mark is detected (or after a 2-second time-out if the 
sync mark is not detected), the blue screen video Is disabled and the audio 
outputs are enabled. 

In manual operating mode, no automatic action is taken at the start of 
a commercial group. During playback in the manual mode of operation, 
device 10/10" functions like a conventional VCR, except that the user has 
the option to view or skip commercials. The recorded video signal, 
including commercials, is played back at normal speed. However, at any 
time the user can press the SKIP button, which causes device 10/10' to 
immediately generate a blue video screen, mute the audio, and fonvard 
scan to the start of the next program segment, thereby skipping over the 
current or next commercial group. Note that the VCR will start skipping to 
the end of the next commercial group as soon as the SKIP button is 
pressed (regardless of whether the VCR is currently in a commercial or 
television program segment). The skipping process will automatically stop 
at the end of the next commercial group. 

In order to improve the effectiveness of commercial elimination, it 
may be desirable to bypass automatic fast scanning of certain commercial 
groups. In particular, commercial groups at the beginning and ending of a 
recorded program often contain promotional messages, teasers, program 
lead-ins/lead-outs and other material that many viewers wish to see. Such 
materials are often interspersed with commercials and may be classified as 
such by the commercial detection algorithm. Accordingly, it may be 
desirable to refrain from automatically fast scanning through commercial 
groups at the beginning and ending of a recording session. Such groups 
would nevertheless be marked in the manner previously described and 
could therefore be scanned through upon actuation of the SKIP button. To 
obtain the full benefit of this feature, it is preferable that each program which 
the user desires to record be made the subject of a separate recording 
session. Thus, even if two programs which the user desires to record are 
aired back to back, VCR timer commands should be separately entered for 
each program. Otherwise, lead-ins and lead-outs between the two 
programs may be automatically scanned through. 
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Over-ride Operation 

During the playback phase, the user may wish to stop the 
commercial skipping process. This can be accomplished in two ways. The 
user can disable commercial elimination entirely by selecting OFF with the 
MODE switch. This will cause the VCR to play the tape as would a 
conventional VCR. No further commercial elimination actions are taken 
until reenabled by the MODE switch. 

Alternatively, the user can temporarily over-ride commercial 
elimination while the VCR Is skipping a commercial group as shown at 
block 520 in Figure 10. This may be conveniently accomplished by 
pressing Play on the remote control or front panel of the VCR. If the VCR is 
currently skipping a commercial group, the reception of the Play command 
will cause the VCR to immediately resume normal play mode and cancel 
blue screen and audio muting. This feature allows the user to temporarily 
stop the commercial elimination operation if the user wishes to view the 
commercial. This feature can also be used in the event that a commercial 
group is falsely detected during program material. Alternatively, the user 
can simply press the stop button to stop the VCR. 

Over-ride operation does not change the cun-ent operating mode 
and does not disable commercial elimination functions except within the 
commercial group being skipped at the time of the over-ride. After an over- 
ride, the VCR will again skip the next commercial group If the automatic 
mode is selected. Commercial elimination can only be pemianently 
disabled by setting the MODE switch to OFF. 

Once a commercial group is over-ridden, device 10/10' will no longer 
attempt to skip that commercial group while in the automatic mode unless 
the tape is positioned at least three minutes ahead of the start of the group. 
This allows the user to back up and view a skipped video segment (which 
may have been falsely marked as commercial) without the playback phase 
attempting to skip that video segment again. This will occur when the tape 
is rewound to any position less than three minutes before the start of the 
group. However, for playback that occurs more than three minutes from the 
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start of the over-ridden commercial group, device 10/10' will perform the 
normal commercial skipping process. 



COMMERCIAL DETECTION ALGORITHM 

The commercial detection algorithm detects the presence and 
location of commercial groups within a television program. The algorithm 
processes data obtained during a recording session in the form of an "event 
list". The event list is stored temporarily in RAM memory until it is 
processed, either during or at the end of the recording session. The list 
contains entries for each occurrence of an event. In the described 
embodiment designed for the North American television market, the 
detectors respond to "black" and silent video frames, and an event is 
declared if both conditions occur simultaneously. 

By analyzing these events, and the timing relationships between 
them, the detection algorithm is able to determine the probable locations of 
commercial groups within the recorded session. The result of this analysis 
is a commercial group list, which Indicates where the commercial groups 
start and end on the video tape. 

Each event in the event list contains the value of the real-time tape 
counter at the beginning of the event. The detection algorithm detennines 
the interval between events, measured in video frames. By applying a set 
of logical rules, the algorithm determines if the segment defined between 
two events is a commercial or a program segment. The algorithm takes 
each event and processes all subsequent events that occur within a time 
window established by the decision rules. For each of these subsequent 
events, the time differential dt is calculated and the following decision rules 
are implemented: 

1 . Is dt less than or equal to 34.99 seconds? 

2. Is dt less than 49.99 seconds and greater than 43.0 seconds? 

3. Is dt less than 64.99 seconds and greater than 58.0 seconds? 
If there is an affirmative response to any one of the decision rules, the 
corresponding segment following the event being examined is considered 
to be a commercial. The foregoing decision rules have been optimized for 
maximizing the commercial detection rate and minimizing the program (i.e., 
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false commercial detection) error rate for North American television 
broadcasting. Different decision rules may be required in other television 
markets. For example, as mentioned above, there are no black frames to 
identify commercials In Japanese television broadcasts. Here, the decision 
rules take advantage of the high degree of accuracy (within a few frames) in 
the length of commercial messages. In other markets, such as Europe, 
there Is little consistency in broadcast standards so that a combination of 
rule sets is required. 

It will be recognized that the above-stated decision rules may be 
supplemented with additional rules to enhance the accuracy of commercial 
detection. Efforts are ongoing to determine an optimum rule set. At the cost 
of greater complexity, the rules may be adaptively changed for the 
particular recording environment. For example, different rules may be 
invoked as functions of the time of day. broadcast channel, etc. 

After analyzing the event list data, the algorithm has determined the 
suspected locations of individual commercials within the recorded session. 
The next step is to combine these individual commercials into groups of 
commercials. Commercial groups consist of two or more individual 
commercials - it is presumed that a single commercial will not be broadcast 
in isolation. By calculating the start and end times of each commercial 
group, the algorithm generates a commercial group list, which is also stored 
in RAM memory. A group is saved only if the total duration of the group is 
greater than 55.99 seconds. 

Once the commercial group list is completed, or more frequently if 
on-the-fly processing is used, the event list can be erased from RAM 
memory since rt is no longer needed. As described above, the commercial 
group list is used during the marking phase to control the placement of the 
start and end commercial group tape marks. Upon completion of the 
meriting phase, the commercial groups can also be erased from RAM 
memory since the video tape is now pemianently mart<ed with the locations 
of each commercial group. 



SUBSTITUTE SHEET (RULE 26) 



wo 98/07273 



PCT/US97/13962 



Control track marking 

The device of the present invention applies the commercial 
elimination "A" and "B" marks to the control (CTL) track of the video tape. 
The hardware required to support this marking feature already exists in 
most VCRs. The "A" and "B" marks modify the duty cycle of the 
synchronization signal written onto the control track at the time the program 
was recorded. iy/lany VCRs cun-ently implement a similar feature for placing 
index marks on the tape. The preferred technique utilized with the present 
invention for applying marks to the video tape is similar to the one 
described by Hori in U.S. Patent No. 4,570,192. 

Referring to Figure 1 1, the video tape control track signal, as defined 
in the published standards for the VHS fomiat, consists of a periodic signal 
in synchronization with the video frame timing. The signal is recorded with 
a rectangular wave fomiat, and read back from the tape as a differentiated 
pulse train. The pulses indicate the rising and falling edges of the control 
track pulse signal. For video tape synchronization (tracking), the rising 
edge of the signal (positive playback pulse) is used to control the tape 
motor servos; the falling edge (negative playback pulse) Is ignored. 
Therefore, as long as the rising edges of the control track signal are not 
disturbed, the duty cycle of the control track si^al can be altered without 
affecting the operation of the video servo system. 

When ovenwriting the control track with "A" and "B" marks, the VCR 
detects the control track signal and waits until just after the rising edge is 
detected before enabling control track record current. After the rising edge 
is detected, the write current is enabled and the timing of the duty cycle 
measured to control the polarity of the applied signal. The head write 
current is disabled before the actual end of the pulse in order to prevent 
ovenwriting the next rising edge of the control track pulse. 

In order to improve compatibility with various VCR models, and to 
reduce noise associated with fast rise time signals, the leading edge of the 
overwrite wave form is preferably ramped. This improves readability when 
transferring a video tape between machines, that may have different head 
alignments or track widths. 
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Three types of marks are applied to the video tape: sync marks, A 
marks and B marks. These are designed to be compatible with VHS 
standard indexing marks. Each of the three types of marks is unique so that 
the VCR can readily distinguish between the beginning and ending of a 
commercial group. The marks comprise a sequence of video fields in 
which the control track signal is altered to have a duty cycle of either 27.5% 
or 60%. 

The formats of the control track marks are illustrated in Figures 12- 
14. Figure 12 shows the sync mark, which is generated by device 10/10' 
during the recording phase of operation to mark the locations of detected 
events. For operation in North America where one or more black frames is 
a reliable indicator of a program transition, a sync mark is written upon 
simultaneous detection of a black frame event and a silent frame event. 
The sync mark consists of 4 cycles of the control track signal with a 27.5% 
duty cycle. The time between the beginning of the detected event and the 
beginning of the sync mark preferable does not exceed 500 msec. 

The A mark, which denotes the beginning of a commercial group, is 
shown in Figure 13. This mark is written over a con-esponding sync mark 
that was generated during the recording phase. During the marking phase, 
when the sync mark associated with the calculated start of a commercial 
group is detected, the control track is ovenwritten with the A mark. At the 
same time, the VCR tape counter is corrected for any error. If a sync mark is 
not detected within ±2 seconds of its expected position, the A mark is 
nevertheless written, but the VCR tape counter is not updated. 

The length of the A mark is preferably related to the length of the 
commercial group that follows. This allows the option, in the playback 
phase, of placing the VCR In its off-head fast foro/ard mode to scan past a 
long commercial group. In most VCR transports, the off-head fast fonward 
speed Is significantly faster than the on-head forward scan speed. In an 
exemplary embodiment, the A mark has 8 cycles at a 27,5% duty cycle if the 
commercial group has a playing time of three minutes or less and has 12 
cycles at 27.5% duty If the commercial group is longer than three minutes. 
Of course, these numbers are somewhat arbitrary and other values can be 
used if desired. The decision of whether or not to go off-head depends on 
the characteristics of the tape transport mechanism and involves a trade-off 
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between the time required to unload the head and the time saved by 
moving the tape at the higher fast forward speed. With some transport 
mechanisms, it may be more efficient to always remain on-head. 

Figure 14 illustrates the format of the B mark, which is written near 
the end of each commercial group. This mark is written substantially before 
the sync pulse corresponding to the actual end of the commercial group so 
that the tape transport will have sufficient time to retum to the normal play 
speed at the end of a commercial skipping operation and reestablish 
tracking, if necessary. The B mark preferably consists of 24 cycles at 27.5% 
duty cycle and ends at a fixed period of time before the ending point of the 
commercial group. In an exemplary embodiment, the B mark ends 50 
seconds of playtime before the sync mark to accommodate a relatively high 
fast scan speed. It is preferred that the fomnats of the tape markings be 
consistent In all devices built according to the invention so that video tapes 
recorded on any one such device can be replayed on another with identical 
commercial elimination functionality. 

It is possible that A and B marks may be written over previously 
written sync marks. To insure that the marks do not appear to be extended 
as a result of such ovenwriting, each of the marks preferably includes at 
least two cycles of 60% duty factor at the leading and trailing edges of the 
mark so that the mark is clearly delineated. 

In accordance with VHS standards, indexing marks may also be 
encoded on the control track using a variable duty cycle. Index marks are 
typically recorded on the video tape at the start of a recording, or they can 
be manually written or erased In some VCR models. The VHS index mark 
consists of a solid pattern, e.g., 61-64 cycles, of 27.5% duty cycle pulses. In 
order to insure reliable detection of an index mark without interference by 
commercial elimination marks, the VCR control software should require at 
least 25 successive control track cycles at the 27.5% duty cycle for 
identification of an index mark. Requiring 25 cycles for index mark 
detection allows the VCR to differentiate between the commercial 
elimination marks (which are all shorter than 25 cycles) and Index marks. 

Each time a new recording is made, an index mark should be 
recorded at the start of the recording session. This will ensure that the 
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recorded program will not be skipped over as a result of an A mark 
recorded earlier on the tape. This can occur if a user partially rewinds a 
tape and starts a new recording that erases a previously recorded B mark. 
If the tape is subsequently rewound to a position preceding the last A mark 
of the old recording, there is no B mark to cause the VCR to return to the 
play mode. However, since an index mark can also be detected as a B 
mark, recording the Index mark will ensure that the new recording is not 
skipped. 

The following table indicates the number of sequential cycles 
required for reading and writing commercial elimination marks and index 
marks: 



Typg of MarK Write Read 

Sync mark 4 cycles 2 to 4 cycles 

A Mark (short commercial group) 8 cycles 7 or 8 cycles 

A mark (long commercial group) 12 cycles 11 or 12 

cycles 

^ 24 cycles >16 cycles 

'"^^'^ "^^'■•^ ^ 61 cycles >25 cycles 

When reading 1. 5, 6. 9 or 10 cycles, no valid mark is detected. 

The marking operation, briefly described above in connection with 
Figure 10, Is accomplished with the following steps: 

1 . Rewind to a position before the start of the first commercial 
group in the recording session. 
2(a) . Play until 2 seconds prior to start of the commercial group. 
2(b). Detect sync mark (or time-out after 2 seconds if sync mark not 
found). 

2(c). Con^ct for error in real-time tape counter. 
2(d). Overwrite control track with "A" mark. 
2(e). Begin fast fonward or scan toward the end of the group. 
2(f). Enter play mode 55 seconds (or as far in advance as 
required) prior to the end of the group. 
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2(g). Overwrite control track with "B" mark. 

2(li). Advance to the start of next commercial group. 

3. Repeat 2(a)-{h) above for all commercial groups. 

4. Fast fonward to end of recording session and stop, 

SEMI-AUTOMATIC OPERATION WITHOUT TAPE MARKING 

In the previously described embodiments of the invention, events in 
the video signal are detected and analyzed to determine the location of 
commercial messages and the videotape or other recording medium is 
marked for the purpose of automatically skipping such messages during 
replay of the recorded program. In an alternative embodiment of the 
Invention, event detection and analysis may be performed during playback 
of the recorded program rather than at the time the program is recorded. 
This mode of operation is somewhat simpler to implement than that 
previously described since marking of the tape or other recording medium 
is eliminated. This permits the commercial-free viewing of television 
programs that were previously recorded with conventional recording 
equipment, including pre-recorded videotapes or discs of motion pictures. 
On the other hand, this mode of operation Is only semi-automatic since 
viewer action is required to begin the skipping process and, therefore, it 
cannot offer the automatic "seamless" elimination of commercials that is 
possible with the previously described embodiments. 

Several slightly different operating modes may be provided 
depending on the nature of the video program and the viewer's desires. 
For example, pre-recorded videos of motion pictures typically include a 
number of "trailers", commercials and other advertising messages before 
the feature presentation. These can have an aggregate playtime of ten 
minutes or more, which is often an unwelcome distraction to the viewer. 
The viewer may therefore wish to skip directly to the beginning of the 
feature presentation. Alternatively, some viewers may prefer to view some 
or all of the trailers for other motion pictures, but still would like to skip 
commercials and other messages. The viewer may select the desired 
operating mode using additional operator controls or using additional on- 
screen menu options. 

In one mode of operation illustrated in Figure 16, apparatus 10' is 
adapted to automatically search for the start of a feature motion picture. In 
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this mode, the viewer activates skip button 128 to commence fonward 
search. As will be explained below, events that characteristically separate 
the trailers, commercials and other segments of the video preceding the 
feature motion picture are detected during the forward search mode. When 
no event has been detected within a predetermined period of time, 
denoting that the feature motion picture has begun, the apparatus returns to 
the location of the last detected event and then returns to the normal play 
mode. Alternatively, the apparatus may enter a pause or stop mode and 
present an on-screen message to the viewer to indicate that the feature 
motion picture is ready to be viewed. 

A second mode of operation is illustrated in Figure 17. Here, the 
viewer is provided the opportunity to view the trailers that precede the 
feature presentation. When skip button 128 Is actuated apparatus 10' will 
enter the fonward search mode as In the previously described mode of 
operation; however, it will locate the beginning of the next trailer and then 
enter the nonmal play mode. If the skip button is actuated again, apparatus 
10' will again enter the fonward search mode to locate the next trailer or, if 
there is none, the feature presentation. 

Forward search may be initiated by automatically sensing that a pre- 
recorded movie has been inserted into device 10'. This may be 
accomplished by examining the video signal. In this regard, most pre- 
recorded movies have a copy protection feature, wherein a pattern of white 
bars is cyclically modulated in a portion of the vertical blanking Interval. 
The presence of such copy protection is easily detected with the video 
event detection circuitry of apparatus 10'. Other video characteristics of 
pre-recorded movies include the absence of commercial elimination 
markings and recording at standard play (SP) speed. These characteristics 
can be used to exclude recordings that are clearly not pre-recorded movies. 

Figure 18 illustrates a third mode of operation intended for use with 
home recordings of television programs. This mode operates in essentially 
the same manner as the two modes described immediately above, except 
that the timing constraint is optimized for commercial groups in broadcast 
television programs. As in the previously described modes, the viewer 
presses skip button 128 to cause apparatus 10' to enter the forward search 
mode. Normally, this would be done as soon as a commercial message is 
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recognized; however, skip button 128 may be pressed at any time that the 
viewer wishes to advance to the next program segment (i.e., to the 
beginning of the program following the next commercial group). Apparatus 
10' remains in a fonward search mode until the skip button is again pressed 
or until 65 seconds have elapsed without detection of an event. In either 
case, apparatus 10' returns to the location of the last detected event and 
enters the normal play mode. 

Figure 1 9 is a functional flow diagram of the above-described 
operating modes, ail of which avoid the use of tape marking. These modes 
may be implemented by way of software in device 10'. During playback of 
a recorded program, it is not possible to detect the beginning of a 
commercial message since an event that may be associated therewith may, 
in fact, be an isolated event within the program itself. Thus, the mere 
detection of an event is not a reliable means for initiating skipping, in these 
modes of operation, therefore, the manual skip button 128 must be used by 
the viewer to begin skipping. The state of the skip button 128 is monitored 
until actuation thereof is detected. At that time, devtee 10' is placed in the 
fast scan mode. Optionally, a blue screen or other special display may be 
presented to the viewer. Once the skip button has been actuated, detection 
of the end of the commercial group and resumption of nonnal play is 
performed automatically without further action on the part of the viewer. 
However, the viewer may override automatic operation and resume normal 
play at any time by actuating the skip button again. 

Barring viewer inten/ention, the video signal is monitored for events 
during fast scan operation. Event detection is performed substantially in the 
same manner as previously described. Certain aspects of event detection 
are unique to this mode of operation and are described below. 

If no event is detected after a fixed period of time, say fifteen minutes, 
normal play mode is resumed. This is an exception condition which may be 
due to a poor quality video signal or some other factor that prevents 
detection of events. When an event is detected, the current value of the real 
time tape counter is stored and a time-out timer is started. The system 
continues to monitor the video signal for events and to store the 
corresponding value of the real time tape counter and to reset the time-out 
timer as each event is detected. If the time-out timer expires or if the skip 
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button is again actuated by the viewer, device 10' enters a reverse searcin 
mode to locate the real time tape counter value corresponding to the last 
detected event. If reverse search was entered as a result of expiration of 
the time-out timer, the last detected event will normally correspond to the 
end of a commercial group. When the transport has retumed to the position 
of the last detected event, normal play mode Is resumed and normal audio 
and video is restored. In the particular case of advancing to the beginning 
of a pre-recorded video of a motion picture, it is preferred that the transport 
stop or pause, at which time the viewer may be alerted with an on-screen 
message that the feature presentation is ready for viewing. 

During the reverse search mode, the viewer may inten/ene with the 
skip button to continue the fonward skip mode. This effectively overrides the 
time-out timer. Fonward skipping will continue until the time-out timer again 
expires or until the viewer again intervenes. It will be recognized that 
viewer inten/ention in these latter circumstances will generally not occur if a 
blue screen is presented during skipping since the viewer will be unaware 
of the current program content. 

The particular time-out value that is used depends on the selected 
operating mode. When viewing previously recorded broadcast television 
programs with typical commercial message clusters, a time-out value of 65 
seconds is preferred. When viewing pre-recorded videos of motion 
pictures, two options may be provided to the viewer as discussed above. If 
the viewer desires to advance the video directly to the beginning of the 
feature presentation, a time-out value of 190 seconds is preferred. 
However, if the viewer wishes to view some or all of the trallere that typically 
precede the feature presentation, a time-out value of 21 seconds is 
preferred. This will effectively skip shorter messages and logo screens and 
will allow the viewer to step to the next trailer by simply actuating the skip 
button 128. 



Event Detection 

As mentioned above, event detection in a fast scan mode of 
operation is somewhat different from event detection in a recording mode of 
operation. Video noise bars are commonly seen in high speed playback of 
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video tape. The noise bars are caused by tiie video iieads crossing 
between successive video fields as the tape is moved at high speed in 
relation to the video head scanning. The amount of video noise depends 
on several factors: 

• The number of video heads 

• The tape recording speed (2 (SP), 4 (LP) or 6 (SLP) hour 
mode) 

• The transport search mode speed 

• The configuration of the video drum 

• TTie geometry of the video heads, including head gap size 

• Differences between recording and playback tape transports 

• The quality of the video tape 

• What video was recorded on the tape before the current 
recording 

• The type of video signal processing used in the VCR circuitry 

Search mode noise bars are much worse In two head VCR 
configurations. In these machines the noise bars are generally much wider 
and disturb more of the picture. On four head machines, the size of the 
noise bars is reduced. In SLP mode there are usually more noise bars 
visible on the screen in comparison to SP mode. The number of noise bars 
depends on the speed of the tape transport in search mode. Noise bars 
can easily trigger black video detector circuits and prevent accurate 
detection of black events during search mode. 

Since pre-recorded video tapes of motion pictures are recorded in 
SP mode, event detection for such tapes is only required to operate in SP 
mode. In addition, the black events found between video segments on 
rented tapes are generally longer than 10 video frames. This means that a 
simpler detection system can be used for pre-recorded movies since it is 
not required to operate In SLP tape speed, and does not need to detect fast 
video black frames. 

Home recordings of television programs may be made in either SP 
or SLP tape speeds. Black events found in television recordings can be as 
short as 1 or 2 frames. This demands a more accurate detection system, 
capable of performing in SLP mode and able to detect short black events. 
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Several approaches have been developed to eliminate false black 
video detection from search mode video. An analog approach simply filters 
the video signal to eliminate the noise bars from the detection signal. A 
second approach uses the video RF head select signal (commonly found in 
4 head machines during SP search mode). A third approach uses a 
software analysis of the video signal to eliminate the noise bar data. 



Analog Filtering 

The analog video and audio detectors Illustrated in Figures 2 and 3 
can be easily modified to improve the ability to detect events in the 
presence of noise bars. A simple RC filter Is added to the detector circuitry 
in place of the low pass filters 206 and 308. This filter performs a peak- 
averaging function which reduces the high frequency video and audio 
noise that is introduced into the video signal in a fast scan mode. The 
output of the peak-averaging filter is then compared to a fixed threshold as 
previously described. Samples for each video field are then analyzed in 
the microprocessor. 

Since this detection works on the entire search mode video field 
(which consists of several Individual recorded fields), short black events 
may be missed. This makes this detection method suitable only for pre- 
recorded movies, which are only required in SP mode. This simple 
detection method does not perform well enough for home recordings of 
television programs which are more likely to be recorded in SLP mode. 
These require one of the more sophisticated approaches described below 
that analyzes the video signal in order to detect high speed black events. 



Gating with Video Head Signals 

By looking for characteristic video patterns, such as a succession of 
black bands, the software can detect that a black frame has been passed in 
search mode. This approach works well for event detection in all modes of 
operation. 

To eliminate the effects of noise bars on black video detection, the 
video detector requires a gating signal that occurs coincidentally with the 
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video noise. This gating signal can be used to mask the black detector and 
eliminate talse "non black" video detection when searching over black 
video events. 

This gating signal is commonly available In 4 head VCR designs 
during SP search mode. The signal is used to select between the SP and 
SLP tape heads as the heads pass over video tracks in SP search mode. 
This existing signal can be applied to the detection microprocessor in order 
to mask line detection occurring near the transition points of this signal. 

It may be possible to create this signal in SLP tape speed, also. 
Depending on the VCR head design, analog processing of the head RF 
signal may be able to produce this gating signal even in SLP mode. This 
can provide an accurate method of noise bar elimination. 

Figure 20 illustrates the signals commonly found in the VCR during 
search mode on a four head machine in SP mode. The gating signal is the 
same signal commonly used for head switching in four head configurations. 

The microprocessor uses this signal as an input to instruct the 
detection software to ignore black detection that occurred shortly before the 
signal and shortly after the signal. This signal also provides an indication of 
each noise bar (the video occurring between noise bars). This allows the 
software to detect very short black events, such as events that are only 2 or 
3 frames long. 



Software analysis 

Special software processing operating in conjunction with digital 
event detection as described earlier In this specification may be used to 
accurately Identify the occurrence of silent frame and black frame events in 
fast scan modes. The software analyzes the integrated luminance values to 
recognize the characteristic pattern of noise bars in an otherwise black 
frame. For example, ten contiguous lines of "black" video may be required 
to declare a black "band". If three such bands are obsen/ed sequentially, a 
video event is declared. An audio event must also be observed, although it 
may be skewed In time relative to the vkieo event, if the audio detector 
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finds a below-threshold (i.e., "silent") audio level within +/- 100 msec, (play 
time) of a video event, a valid event is declared. 



INFORMATION DECODING 

It will be recognized that the video event detection capability of 
device 10/10' has the inherent capability for decoding information 
modulated on the video signal. Individual video frames can be modulated 
as black or non-black to provide a simple binary coding scheme. Although 
this affords a relatively low data rate, it can be an effective way to transmit 
data to device 10/10* If only black frame detection Is provided. One 
application for such data communication is the transmission of time-of-day 
information so that the buHt-ln clock of device 10/10* will always have the 
correct time. Inexpensive television broadcast time is often available in 
early morning hours. Such time can be advantageously utilized to transmit 
information to all receiving devices. The devices can be preprogrammed to 
scan for information at certain times of the day when normal use of the 
device is unlikely. Thus, for example, the device may enter a scan mode at 
3 a.m. to search for a data header encoded with black frames. When the 
header is located, the data which follows is decoded and stored in 
processor 114. Aside from tIme-of-day, the coded information may include, 
for example, new operating instructions for processor 114. In this way, the 
commercial elimination algorithm can be periodically and automatically 
updated. 

It should be apparent that the data communication bandwidth can be 
substantially higher in device 1 0' since up to each video line can be 
sampled. If ail video lines are utilized to encode individual data bits, the 
communicatfon bandwidth Increases to 15,7 kHz. 

It will be recognized that the above described invention may be 
embodied In other specific fonms without departing from the spirit or 
essential characteristics of the disclosure. Thus, it Is understood that the 
invention is not to be limited by the foregoing Illustrative details, but rather is 
to be defined by the appended claims. 
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CLAIM 

WHAT IS CLAIMED IS: 

1 . A video playback system comprising: 

(a) a video player having a play mode, a fast scan mode 
and a reverse mode; 

(b) a recording medium for insertion into the video player, 
said recording medium having a video signal recorded thereon; 

(c) means for commanding the video player to enter the 
fast scan mode; 

(d) event detection means for detecting events within the 
video signal; 

(e) timer means for determining that a detected event is not 
followed by another event within a predetermined period of time; 

(f) means responsive to said timer means for commanding 
the video player to enter the reverse mode until reaching a position 
on the recording medium corresponding to said detected event 
which is not followed by another event within a predetermined period 
of time. 

2. The system of claim 1 wherein the recording medium is a 
video tape. 

3. The system of claim 1 wherein the recording medium is an 
optical disc. 

4. The system of claim 1 wherein the recording medium is a 
magnetic disc. 

5. The system of claim 1 wherein the means for commanding the 
video player to enter the fast scan mode comprises a manual control. 

6. A video playback system comprising: 

(a) a video player having a play mode, a fast scan mode 
and a reverse mode; 

(b) a recording medium for Insertion into the video player, 
said recording medium having a video signal recorded thereon; 
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(c) means for commanding the video player to enter the 
fast scan mode; 

(d) event detection means for detecting events within the 
video signal; 

(e) storage means for storing data identifying a location on 
the recording medium of a most recently detected event; 

(f) means for commanding the video player to enter the 
reverse mode until reaching said location on the recording medium 
of a most recently detected event. 

7 The system of claim 6 wherein the means for commanding the 
video player to enter the reverse mode comprises a manual control. 

8. The system of claim 6 wherein the means for commanding the 
video player to enter the reverse mode comprises a timer that Is initialized 
by said most recently detected event. 

9. The system of claim 6 wherein the recording medium is a 
video tape. 

10. The system of claim 6 wherein the recording medium is an 
optical disc. 

11. The system of claim 6 wherein the recording medium is a 
magnetic disc. 

1 2. The system of claim 6 wherein the means for commanding the 
video player to enter the fast scan mode comprises a manual control. 

1 3. A method of cueing a video tape having a video signal 
containing a program recorded thereon to a beginning of a program 
segment comprising the steps of: 

(a) advancing the video tape at a speed faster than a 
normal play speed; 

(b) monitoring the video signal as the video tape is 
advanced to detect events therein: 
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(c) analyzing the detected events to identify an event 
associated witli said beginning of a program segment; 

(d) reversing the video tape to a location con-esponding to 
said event associated with said beginning of a program segment; 
and 

(e) commencing normal play of said video tape at said 
beginning of a program segment. 

14. A method of cueing a video recording medium having a video 
signal containing a program recorded thereon to a beginning of a program 
segment comprising the steps of: 

(a) advancing through the recorded video signal at a 
speed faster than a normal play speed; 

(b) monitoring the video signal as it is advanced through to 
detect events therein; 

(c) analyzing the detected events to identify an event 
which has no following event within a predetennined period of time; 

(d) commencing normal play of the video signal at a 
location on the video recording medium corresponding to said event 
which has no following event within a predetermined period of time. 
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